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Abstract 

We propose a theory of chaos for discrete systems, based on their representation 
in a space of "binary histories", £>°°. We show that B°° is a metrizable Cantor set 
which embeds the attractor A, itself also a Cantor set. 



* This work is supported in part by CONACyT grant 400349-5-1714E and by the Asso- 
ciation Generale pour la Cooperation et le Developpement 
(Belgium). 



1 



1. Introduction. 

Most recent results on discrete systems concern states at or near equilibrium. Mar- 
tinelli and Oliveri proved that Hamiltonian spin systems relax exponentially, under the 
strong mixing assumption M ; anc [ Comets and Neveu showed that fluctuations of thermo- 
dynamic variables in the Sherrington Kirkpatrick model are Gaussian processes The 
relation of ground states to the vacuum of quantum field theories is well known '^j for 
example Cecotti and Vafa proved their equivalence in the case of the Ising models and 
supersymmetric field theories in dimension d = 2 M . 

Less is known about their behaviour far from equilibrium. Ising models can dis- 
play interesting dynamical behaviour, as Neves and Schonmann showed in studies of the 
transition from a metastable to a stable equilibrium t 5 l in d = 2. Asymmetric Hopfield 
networks have transitions to disordered dynamical phases ®. Also, Cellular automata have 
non-trivial dynamics; soliton solutions were studied by Bobenko, Bordemann, Gunn and 
Pinkall ^. One of the more complex dynamical behaviours in Wolfram's classification ^ 
has been studied empirically as a form of "chaos" ^, but it has never been entirely clear 
how this is related to chaotic dynamics in Euclidean space. 

As is well-known, Markovian dynamics on a finite state space cannot be chaotic 
since every orbit must eventually fall onto a finite limit-cycle. However, one would like to 
have a framework for chaos which allows one to decide whether the complex dynamics of 
finite systems is approximately chaotic. Unfortunately, for most finite systems there is no 
convenient quasi-representation in terms of real variables. There are different points of view 
on this problem, ranging from the fundamentalist, which concludes that a finite system 
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cannot be viewed as approximately chaotic, to the liberal, which reduces the definition 
of chaos to sensitive dependence on initial conditions and the exponential growth of the 
limit-cycle period with the size of the system. 

Our feeling is that "chaos" should not be limited to real variables, as these are 
idealizations of a reality which could be viewed equally well in terms of finite state spaces. 
Indeed, the fact that most real variables have infinite algorithmic information t 10 ! is not 
satisfactory from a physicist's point of view. Yet some form of idealization is necessary to 
define "chaos" rigorously. 

Our purpose in this article is to propose a different idealization, inspired from sym- 
bolic dynamics t 11 - 12 !, which is well suited to finite systems with a natural binary network 
representation (including Ising models, spin glasses and cellular automata). 

Instead of specifying the coordinates of a point with infinite accuracy, we will assume 
that one is given the N — bit model of the system at every past tick of a clock, to the 
infinitely remote past: the state of a binary system is given by 

S={S(0),S(-l),...,S(-n),...}, 

where S (— n) is a binary vector with components S l (— n) G {0,1}; i = l,---,iV. The 
space of such binary histories will be denoted by B°° [Figure 1] . 

The approximation which makes this concept practical, akin to the 128 — bit version 
of floating-point variables, is the truncation of the binary history to the n most recent steps 
in the past. This truncation is valid if the difference between states with the same history 
for the first n steps belongs to a small neighborhood of the origin. We will formalize this 
demand in the definition of the "semicausal topology" , which will be the keystone of our 
construction. 
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Thus, order n Markow chains on finite spaces can have quasi-chaotic dynamics if n 
is large, and be precisely chaotic in the n — > oo limit. Cellular automata and asymmetric 
spin glasses are n = 1 processes, so they do not provide good models of chaos. This fact 
manifests itself in the lack of an invariant attracting set where the dynamics is topologically 
transitive. 

We begin by reviewing definitions for chaotic maps on real phase spaces i 12 K Let 
/ : IR d — > lR d , d G Z+ be a contiuous map, such that x n+ i = f (x n ). 

Definition 1: f : IR d — > JR d has sensitive dependence on initial conditions on A C JR d 
if35>03VsGi and VW (x) (neighborhood of x) 3 y G N (x) and n G IN 3 
\f n (x)-r(y)\>6 f. 

Definition 2: f : IR d — > IR d is topologically transitive on ^4 C IR d if for any open sets U, V 

cA3neT3f n (U)nv^di. 

Definition 3: Let A C IR d be a compact set. / : A — > .4 is chaotic on ^4. if / has sensitive 
dependence on initial conditions and is topologically transitive on A. 

Definition 4- A closed and connected set Ai C IR d is called a trapping region if / (M) C M.. 

Definition 5: The map / has a chaotic attractor A C IR d if A is a compact set on which / 
is chaotic and exists a trapping region M such that A = f] f n (M). 

n>0 

Of the five definitions above, only the first uses the Euclidean metric explicitly. Since 
the property of "chaos" is topologically invariant, we will use a topological definition of 
"sensitivity to initial conditions": 

Definition Ibis: f : IR d — > M d has sensitive dependence on initial conditions on M. C M d 
t IN = {0,1,2,...} 
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if there exists a field of neighborhoods N(x), i.e., a function from the trapping region to 
the continuous topology on IR d , A/" : M. — > t(A4), such that 

Wx 3y G Af(x) n M, n G IN 3 f n (y) <£Af(f n (x)) 

The metrical definition (1) is recovered if one requires that the neighborhoods Af (x) be 
5-balls centered at x. 

2. The Space of Binary Histories B°°. 

Let S = (<Si(£), 52 (£),•••, <Sjv(£)) be an iV — bit binary model of the state of the 
system at time t. We denote the space of the 2 N possible binary states by B = {S} and 
the infinite set of binary histories of the system by 

B°° = {5=(S(0),S(-1),...)}. (1) 

We endow B°° with a topology such that near-neighbors in B°° have similar binary 
states in the recent past. 

Definition 6: A semicausal topology on B°° with index A G IN is a topology generated by 
a base whose elements (£), S G B°° , n G IN satisfy: 

i) S' G AC (S) =^Vm<n, S' (-m) = S (-m). 

it; S' (-m) = S (-m) Vm < n + A ^> 5" G A/jf (S 1 ). 

Note that if 5" G A/^ ^ may or may not have the same binary states S' (— m) of 
S in the range n < m < n + A. One semicausal topology differs from another in which 
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differences are allowed between S' (— m) and S (— m) in this range, for S' G (S) [Figure 
2]- 

It is easy to check that the basis sets (S) satisfy the 
Property 1: A/^+a (S) C (S') V£' G A^a (5). 

Definition 7: The causal topology is a semicausal topology with A = 0. The base elements 
(S) are uniquely defined by i) and ii) above. 

From here on we will assume that £>°° is equipped with a semicausal topology. To 
simplify the notation we will drop the A in the notation and write the basis elements 
simply as N n (S). The following proposition is easy to verify: 

Property 2: B°° is a boolean algebra (a ring with an idempotent cross operation) under 
the logical operations 

XOR = +, (2) 
AND = x (3) 
performed on each bit in the infinite binary chain S. The "zero" is the element 

= (0,0, 0,0,...), (4) 

and the identity is the element 

e = (1,1, 1,1,...). (5) 

The addition operation is nilpotent 

S + S = (6) 

and the multiplication is idempotent 

Sx S = S. (7) 
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Definition 8: The sequence {Sfc}, /c G IN is a Cauchy net if 

Vn G IN 3A; G IN 3 S k - S k ' G M n (0) Vfc, k' > k , 

see Ref. [13]. 

Theorem 1: B°° is complete. 

Proof: We need to show that any Cauchy net of elements in £>°° converges to an element 
in B°° . Let {Sk} be a Cauchy net. From definition 8, Sk' (— m) = Sfc (— m) Vm < n and 
k, k' > ko. Let us construct S from m = down to m = n — 1 such that S (— m) = Sfc (— m) 
Vm < n; by incrementing n this construction leads to a unique binary history S. The 
sequence {S^} converges to S which by construction is of the form (1), so that S G B°° . ■ 

Theorem 2: B°° is Hausdorff. 

Proof: Let S ^ S', then 3n G IN 3 S (-n) ^ S' (-n). The neighborhoods A/" n +i (5) and 
Nn+i (S') are disjoint. ■ 

Theorem 3: £>°° is perfect. 

Proof: A set is perfect if it is closed and every point is an accumulation point. B°° is closed 
because it is the total space so it is both open and closed. Let S G B°° and consider the 
sequence {Sk} given by 

Sfc (—n) = S (— n) , Wn < k 

and 

Sfc (-n) = S (-n) + 1, Vn > k, 
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where 1 is given by (5). This sequence converges to S and by construction Sk ^ S Vfc. 
Thus, S is an accumulation point. ■ 



Lemma 1: If S' $ M n (S) then M n (S) n N m (S') = Vm >n + A. 

Proof: From definition 6, if S' (£ M n (S) then S' (-fc) ^ S (-fc) for some fc < n + A. Let 
S G Af m (5") then S (-fc) = S' (-fc) VA; < n + A < m, which implies that S <£ Af n (S). 

m 

Lemma 2: The complement A/Jj of any neighborhood is an open set. 
Proof: Due to lemma 1, Af£ (S) can be expressed by 

K (s) = U (s') , 

which is a union of open sets, then A/"^ (<S) is an open set. ■ 
Theorem 4- B°° is totally disconnected. 

Proof: We must show that the connected component C (S) of each S G B°° consists of just 
the point S t 14 l 

By contradiction: Let S' £ C (S) with 5" ^ S. Then S and S' differ in at least one 
binary state: S (-n) ^ S' (-n). Then S' <£ N n +\ (S). Now, 

is a separation of B°° because by lemma 2 bought of them are disjoint non-empty open 
sets. This implies that C (S) C J\f n +i (S) but 5" ^ Af n +i (S) and we have a contradiction. 
■ 
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Theorem 5: B°° is compact. 

Before proving the theorem let us first prove three lemmas. 

Lemma 3: The number of distinct sets M n (S) VS 1 G B°° and n fixed, is finite. 

Proof: For any S G £>°°, M n (S) is totally defined by specifying the first n + A binary 
states and the list of which differences are allowed between S' (— m) and S (— n') in the 
range n < m < n + A, in all a finite amount of information for any fixed n. M 

Lemma 4- Let V = {Ui} be an open covering of B°° such that there exists a n G IN 
such that WS G B°° 3m < no 3 M m (S) C Ui for some Ui G V. Then there exists a finite 
subcovering of V. 

Proof: VS G B°° let U a G V be such that S eU a and A/" m (£) C C/ Q with the minimum 
possible m. By lemma 3, the number of distinct Af m (S) with m < no is finite, so the set 
of such base elements {M m (S)}, is a finite covering. Since for each J\f m (S) there is an 
associated U a and J\f m (S) C U a , {U a } is a finite subcovering of B°°. ■ 

Lemma 5: If # : jV n (5") — > IN is a non-bounded function, then there exists Af m (S') C 
M n (S), with M m (S') ^ M n (S), such that ^ : M m (S') — > IN is non-bounded. 

Proof: The neighborhood jV n (S 1 ) can be expressed as a finite union of neighborhoods in 
the following way: let m > n + A, the set 

W = {S' e M n (S) \S' (-k) = S (-k) Vk > m + A} 

is finite and 

M n (S) = |J Mm (S') . 

S'ew 

Then g must be non-bounded in at least one of the M m (S'). ■ 
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Proof of theorem 5: By theorem 2, B°° is Hausdorff then by the lemma 4 it remains to 
prove that for any covering V 3 no G IN 3 \/S G B°° 3m < n 3 J\f m (S) C Ui for some 
Ui G V. By contradiction let us suppose that there does not exist such n. Then there 
exists a covering V such that Vn G IN 35 G B°° 3 Af m (S) C Ui for some Ui G V implies 
m > n. This defines a function 

: — ► IN 

given by g (S) = n, which is not bounded. Then by lemma 5, there exists a nested sequence 
of neighborhoods 

Mil (5i) 3 M 2 (5 2 ) 3 ... D M fc (5 fc ) D ... 

with ni < n 2 < such that # is non-bounded VA/" nfe (^fc). The sequence {S^} is a Cauchy 
net, therefore by theorem 1 it converges to an element of B°° , but that element is not cov- 
ered by V since g — > oo, and therefore we have a contradic- 
tion. ■ 

From theorems 3, 4 and 5 we have the following 
Corollary: B°° is a Cantor set. 

3. Chaotic dynamics in B°°. 

Let us introduce the following notation: by S (n) G B°° with n £ Z we understand 

S (n) = (S (n) , S (n - 1) , S (n - 2) , ...) . (8) 
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A binary dynamical system in B°° is a map F that is induced by non-vanishing continuous 
functions F { : B°° — >JR- {0}, i = 1, N, such that 

S i (n+l) = QoF i (S(n)), (9)) 

where © (x) = 0, 1 for x < 0, x > respectively. The map F : £>°° — ► £>°° is given by 

F(S(n)) = S(n + 1). (10) 

We should stress that due to the fact that B°° is totally disconnected it is not difficult to 
construct continuous non-vanishing functions Fj that change sign. 

Property 3: The dynamical map defined by (10) is continuous. 

Proof: Fi : B°° — > 1R — {0} is continuous and 6 : IR — {0} — > Z 2 is also continuous, so 
the composition 6 o Fi is continuous. ■ 

Now we will extend the definitions 1 to 5 of Sec. 1 in a natural way, so they fit into 
the dynamics generated by F : B°° — > B°°. 

Definition 9: The map F : B°° — ► B°° has sensitive dependence on initial conditions on 
A C B°° if 3n e IN 3 VS G A and VjV m (S) 3S' G N m (S) n A and k G IN 3 F k (S') <£ 
M n {F k (S)). 

Definition 10: F : B°° — > B°° is topologically transitive on A C B°° if for any open sets 
U, V C A 3n G Z 3 F n (U) ny ^ I In the last expression, if F is noninvertible we 
understand the set F~ k (U) as the set of all points S G B°° such that F k (S) G U. 

Definition 11: Let «4 C B°° be a compact set. F : A — ► A is chaotic on ^4 if F has 
sensitive dependence on initial conditions and is topologically transitive on A. 

Definition 12: A closed subset M. C B°° is called a trapping region if F (.M) C 
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Property 4- F n (M) is compact and closed Vn G IN. 

Proof: Since every closed subset of a compact set is compact, it follows that M is compact 
and since F is continuous F n (M) is compact. Since B°° is Hausdorff every compact subset 
of it is closed, so F n (M) is closed ' 15 L ■ 

Definition 13: The map F : B°° — > B°° has an attractor A C B°° if there exists a trapping 
region M such that 

A = p| F n (M) . 

n>0 

Property 5: A is compact and closed. 

Proof: A is an intersection of closed sets, so it is closed. Since every closed subset of a 
compact space B°° is compact, it follows that A is compact. ■ 

Property 6: The restriction of F to A is completely defined by specifying A itself, as follows. 
For any point S G A and n > 1, let S n G A be such that S n (— n — k) = S (—k), for k G IN. 
Then F (S) = (S n (-n + 1) , S n (-n) , ...). 

Proof: Since £ G A, for any n G IN there is an element S n G A such that F n (£) = S n . By 
(9)) F acts as a down-shift map for all but the must recent slice, therefore S n (—n — k) = 
S(-fc), for k G IN. ■ 

Definition 1\: A is called a chaotic attractor if F is chaotic on A. 
Theorem 6: If A is a chaotic attractor then it is perfect. 

Proof: By property 5, A is closed, it remains to prove that every point in A is an accu- 
mulation point of A. By contradiction, let 5o G A be an isolated point, then there exists 
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n E IN 3 Af n (S ) n A = {S } then, by topological transitivity and the fact that F _1 
exits, A consists of an isolated orbit (the orbit of So) but this violates sensitivity to initial 
conditions on A, so A could not be a chaotic attractor. ■ 

Theorem 7: If A is a chaotic attractor then it is a Cantor set. 

Proof: The theorem follows directly from property 5, theorem 6 and the fact that a subset 
of a totally disconnected set is also totally disconnected. ■ 



4. Metric in B°°. 



The space B°° is metrizable as we will see below. This enforces its utility in using it 
to model chaotic dynamical systems. 

Definition 15: A metric d(Si, S 2 ) is called semicausal if it induces a semicausal topology. 

Definition 16: A metric over B°° is bounded if 3M e TR 3 VSi, S 2 G B°° d(S u S 2 ) < M. 

Definition 17: A metric on B°° is local in time if there exist real numbers a > 1 and w > 
such that 

d(S u S 2 ) < wa~ n 

implies that 

Si (-m) = S 2 (-m) 

Vm < n. 

13 



The following is an example of a semicausal metric in £>°°: 
d(S u S 2 ) 



\^ 1 d n (Si + S 2 ) , . 

^ 2M + d n (S 1 + S 2 ) [ } 



where 

N 

d n {S) = Y J S i {-n) 

and the plus sign is defined by (2). Note that d n (Si + S 2 ) is the Hamming distance of 
the binary models Si(— n) and S2(— n). It is easy to check that (11) satisfies the following 
properties: 



i) d(S u S 2 ) < VSi, S 2 G so it is bounded. 

%%) cZ is semicausal with A = 2. 

Hi) d is local in time. 

It is possible to define a "dot" product in £>°° given by 



s s , = ^]__dn(SxS') 

2 n 1 



, ; _ - - + d n (SxS') 

where the "cross" product is defined by (3). Using equations (6) and (7) the metric (11) 
can be written as 



d {S u S 2 ) = v / (Si + S 2 )-(S 1 + S 2 ). 
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5. Conclusion. 



From an initial ansatz, to replace the usual idealization of physical states as "points" 
on a differentiable manifold by another idealization as infinite "binary histories" , we pro- 
ceeded to define a class of topologies which make the truncation to finite binary histories 
a valid approximation, in the same sense that the continuous topology on JR d allows one 
to approximate a real coordinate by a finite string of digits or bits. With this topology 
and the natural Boolean algebra structure, the space of binary histories was shown to 
have several interesting properties, including those of Cantor sets: it is compact, totally 
disconnected and yet every point is an accumulation point. 

Continuous dynamical maps on the space of binary histories can lead to attracting 
sets within B°° , in which case an attractor is defined in the usual way. The dynamical map 
is said to be chaotic on the attractor if it is sensitive to initial conditions and topologically 
transitive. 

It is remarkable that the dynamics on the attractor is uniquely specified by the 
attractor itself (Property 6): given any initial state on the attractor, 

5 = {S(0),S(-1),.-.}G A. 

one finds, for each n, one and only one state S n G A such that 

5 n = {S n (0),S n (-l),S n (-n+l),S(0),S(-l),-..}. 

Indeed, since S G A and F (A) = A, one has S n G A; S n is unique because S n = 
F(S n -i), S' n = F(S n -i) =>• S n = S' n . The dynamics is then given by F(S) = Si, 
F(F(S)) = S2, etc. In other words, to determine F(S) it is sufficient to scan A in search of 
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the state Si which is equal to S downshifted one step in time, with the extra binary model 
Si (0) on top; in this sense the dynamical map is related to a shift map, as in symbolic 
dynamics. 

The relation to symbolic dynamics is suggestive, and one might wish to regard our 
formalism as its generalization. However, there are some non-trivial differences between 
chaos on B°° and the shift map on the space of itineraries T, N of Ref. [12]. First of all, 
points of B°° represent the history of the binary system towards the past only, whereas 
itineraries extend also to t — > +00. Secondly, we are describing chaos on a proper subset A 
of a larger binary space, B°° , so that £>°° plays the role of "embedding space". In contrast, 
the chaotic dynamics on all of Y> N is homeomorphic to that which takes place on a Cantor 
subset H of the attractor, that is S C A C IR d . In other words one needs to appeal to 
a homeomorphism to IR d for the embedding space. The two differences, one related to 
causality and the other to the intrinsic nature of the embedding space B°° , allowed us 
to develop the formalism of chaos on binary systems without ever invoking differentiable 
manifolds, thereby lending support to our claim that this formalism can be regarded as a 
different representation of reality based on binary histories rather than real variables. 

One could go one step further and suggest that other theories of physics could be 
rewritten by thinking of £>°° as the space of physical states and call "real" the elements S G 
£>°° rather than the coordinates on differentiable manifolds. Of course that would probably 
turn out to be rather inconvenient for most systems; we are only making this outrageous 
suggestion to emphasize that the mathematical constructions which best represent reality 
are nothing but those which make reality look simple; in this sense surely B°° is a more 
appropriate framework to describe the physical reality of binary systems than differentiable 
manifolds! 
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The fact that B°° is a Cantor set is perhaps not surprising in light of the analogy 
to the symbolic dynamics of chaotic maps / : M d -> M d . If one regards an iV — bit 
binary vector S (0) as defining a partition of phase space into 2^ disjoint subsets O a , 
a = 1, 2, • • • , 2^, then the specification of two consecutive binary vectors, {S (0) , S (—1)} 
defines a finer partition into subsets O a fl / (Op). For example the O a might be thought 
of as a tiling of phase space, in the sense of Berend and Radin t 16 l. 

Repeating the procedure to finer and finer partitions one obtains the image of £>°° in 
real phase space as the infinite intersection set 

|J (0 a n / (O,,) n / 2 (0 7 ) n • • •) , 

{a,/3,7,---} 

much like the textbook construction of the Cantor set from the intersections of the intervals 
I = (0, 1), / (I) = (0, J) U (§, 1), etc. Note that one could replace an N — bit description 
of the state for two consecutive time steps by a 2N — bit description for a single time 
step, based on a partition of phase space into 2 2N disjoint cells O a fl f(Op); this indicates 
that there is an exact renormalization group transformation relating refinement in space 
with extension of binary histories towards the past; this may be an interesting line of 
investigation to pursue which might be expected to raise issues of universality along the 
lines of Feigenbaum's work t 17 l 

One rather common example of truncated binary histories is the case of computer 
models for chaotic time series prediction. In the so-called "method of delays" ^ 18 \ the 
coordinates of a point in phase space are taken to be the delayed measurements of a single 
variable, so that the state vector is given by x = {x(0), x(—l), x{— 2), x(—T + 1)}. 
Here, T is the embedding dimension and each coordinate is represented as a 128 — bit 
binary word. The Euclidean metric in 1R induces a semicausal metric on the space of 
binary histories. 
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A priority in the continuation of this work is to further elucidate the connection 
between chaos on binary systems and real chaos. One notes first of all that there cannot 
be a homeomorphism between the embedding space B°° and IR d : one is a Cantor set and 
the other a differentiable space! The reason why real and binary embedding spaces cannot 
be homeomorphic is that given any map from the space of binary histories to real phase 
space, there is a continuous curve in the latter which takes one across the boundary which 
separates binary histories beginning with distinct binary vectors, S' (0) ^ S (0), so the map 
is discontinuous at the boundary. This fact should not be regarded as a serious problem, 
since chaos is defined on the attractor and there is no impediment to a homeomorphism 
from the attractor A C £>°° to a Cantor subset of R d , or for that matter from £>°° to a 
larger Cantor subset of IR d . The formal connection between chaos on the space of binary 
histories and real chaos is the subject of ongoing research. 
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Figure Captions 

[1] A state in the space of binary histories, S G £>°°, is a succession of N — bit binary 
words giving an approximate description, or "model" of the system at times t = 
0,-1,-2,-., 

[2] A state S' in the neighborhood J\f^(S) has the same binary words as S for the slices 
t = 0, —1, • • • , — n and can have any binary word at all beyond t = —n—A. In between 
these two bounds, the differences which are allowed for S' E J\f^(S) characterize the 
particular semicausal topology. 
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